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Single-Dirac-Cone topological surface states in TlBiSe 2 class of Topological Insulators 
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We have investigated several strong spin-orbit coupling ternary chalcogenides related to the 
(Pb,Sn)Te series of compounds. Our first-principles calculations predict the low temperature rhom- 
bohedral ordered phase in TlBiTe 2 , TlBiSe 2 , and TlSbX 2 (X=Te, Se, S) to be topologically Z 2 = -1 
nontrivial. We identify the specific surface termination that realizes the single Dirac cone through 
first-principles surface state computations. This termination minimizes effects of dangling bonds 
making it favorable for photoemission (ARPES) experiments. Our analysis predicts that thin films 
of these materials would harbor novel 2D quantum spin Hall states, and support odd-parity topo- 
logical superconductivity. For a related work also see arXiv:1003.2615vl. Experimental ARPES 
results will be published elsewhere. 
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Topological insulators are a recently discovered new 
phase of quantum matter [lH3||. The search for topo- 
logical insulators in real materials has benefitted from 
the fruitful interplay between topological band theory of 
Kane and Mele (2005) and realistic band structure calcu- 
lations [4H12l|. As a result, Bi^Sbi-a;, Bi2Se3 and Bi2Tc3 
have been experimentally realized as three-dimensional 
topological insulators [(MA I 111. Il2|. Recently, this search 
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has been extended to ternary compounds 13|, [l4|. Here, 
we report first-principles band calculations of Tl-based 
III-V-VI2 ternary chalcogenide series, and compare the 
results to those of the related (Pb,Sn)Te series studied 
previously in connection with Dirac fermion physics in 
the 1980s [la]. The low temperature rhombohedral or- 
dered phase in TlBiTe 2 , TlBiSe 2 , and TlSbX 2 (X=Tc, 
Se, S) is predicted to be topologically nontrivial. More- 
over, we have carried out first-principles slab computa- 
tions in order to identify the specific surface termination 
which gives rise to the simple Dirac-cone surface band for 
ARPES measurements. An analysis of the symmetry of 
states indicates that thin films of the present materials 
would support 2D-quantum spin Hall states. 

Designing new topological insulators involves modify- 
ing atomic structure or doping to shift band orders out 
of the natural sequence. Consider, for example, the well- 
known case of (Pb,Sn)Te with rocksalt structure. The 
end phase PbTe with face-centered cubic (FCC) lattice 
is topologically trivial. In contrast, SnTe has band inver- 
sions at four equivalent L-points where parities of con- 
duction and valence bands are switched (Fig. 2E). Since 
this inversion occurs at an even number of points in the 
Brillouin zone, SnTe is also a topologically trivial band 
insulator. Fu and Kane [5] proposed that a rhombohe- 
dral distortion along a particular 111 direction can in- 
duce (Pb,Sn)Te into a strong topological phase because 
then the band inversion occurs only at the L-point along 
the 111 direction which is distinguished from the other 
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FIG. 1: (Color Online) (A) Crystal structure of idealized FCC 
TlBiTe 2 . Tl surface is emphasized by black lines, Bi surface 
by dotted lines, and the Te surface by gray lines. (B) FCC 
Brillouin zone. Thick red arrow marks the 111 rhombohedral 
distortion direction. 



three L-points (Fig. [TJ3). 

The Tl-based HI-V-VI 2 ternary chalcogenides MM'X 2 
are, or can be, approximately viewed as a rhombohedral 
structure with space group i?3m[l|| with a center of in- 
version symmetry. The unit cell contains four atoms: M 
= Tl, M' = Bi or Sb, and X = Te, Se, or S atoms, which 
occupy the Wyckoff 3a, 3b, and 6c positions, respectively. 
If M — M' and the corresponding hexagonal lattice con- 
stants a and c satisfy the relation c = 2%/6a, a rocksalt 
FCC structure is restored with a' = v2a with only two 
atoms/unit cell. The rhombohedral lattice is embedded 
in a 2x2 supercell of the FCC lattice as shown in Fig. UK . 
This relation between rhombohedral and FCC lattices is 
analogous to the type II antiferromagnet NiO with M = 
Ni spin up, M' = Ni spin down, and X = O. In this sense, 
Tl-based III-V-VI2 ternary chalcogenides constitute an 
offshoot of the IV- VI semiconductors and can be called 
pseudo IV- VI semiconductors 17H22J . Taking the exam- 
ple of TlBiTe 2 , because Tl and Bi precede and follow Pb 
in the periodic table, TlBiTe2 resembles PbTe where M 
— M' = Pb. Therefore, by distorting the PbTe crystal 
along a 111 direction and replacing Pb by Bi and Tl al- 
ternating along that 111 direction, one obtains TlBiTc2 
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FIG. 2: (Color Online) (A)-(D) Band structures of 

PbTe; PbTe in a supercell rhombohedral structure with 4 
atoms/unit cell; PbSnTe2; and TlSbTe2 with FCC atomic po- 
sitions. FCC symbols for points in the Brillouin zone are used 
as in Fig. 1(B) for ease of comparison. Size of red dots denotes 
the probability of s-orbital occupation on the M atoms. (E) 
Band inversion at L for SnTe relative to PbTe. (F) and (G) 
highlight band inversion at the V- and X-points for PbSnTe2 
(C) and TlSbTe 2 (D), respectively. 



with rhombohedral structure. In the ordered crystalline 
phase, the X atom moves away from the FCC position. 

Since Tl-based III-V-VI2 ternary chalcogcnidcs pro- 
vide a rhombohedral version of (Pb,Sn)Te, one may ex- 
pect these compounds to display topologically non-trivial 
phases. We have explored this possibility by perform- 
ing first-principles calculations 23] within the framework 
of the density functional theory (DFT) using the gener- 
alized gradient approximation (GGA) 24]. Spin orbital 
coupling (SOC) was included as a second variational step. 
The lattice constants were taken from the optimized val- 
ues given in table I of Ref. LUJ 

To better explain the relationship between (Pb,Sn)Te 
and the Tl-based III-V-VI2 ternary chalcogenides, Fig. 2 
shows the evolution of bands for a sequence of structures 
going from FCC PbTe (Fig. 2A) to TlSbTe 2 (Fig. 2D). 
For FCC PbTe, the top of the valence bands is located 
at the L-points with a small gap. When the same calcu- 
lation is repeated by assuming a rhombohedral unit cell 
with two chemical formula units, doubled along a 111 
axis, we obtain the folded bands of Fig. 2B. In particular, 
the top of the valence band at one L-point is folded to the 
T-point, and the other three L-points are folded to three 
equivalent X points. Since no distortions are introduced 
yet, the bands do not interact with the folded bands. 
In the next step (Fig. 2C), we replace one of the Pb 
atoms by an Sn atom, resulting in alternating Pb and Sn 
planes along the selected 111 direction. The original and 
folded bands now interact, inducing new band gaps and 
avoided crossings for the hypothetical ternary compound 
PbSnTe2. Otherwise, the band structure is superficially 
similar to that in Fig. 2B. The conduction and valence 



bands now become inverted at high symmetry points. 
The band inversion effect can be monitored through the 
probability of s-orbital occupation (red dots) [25| on the 
M atom (here M = Pb) at the inversion center. Com- 
paring the band sequence with red dots for PbTe and 
PbSnTe2, we see that band inversion indeed occurs at 
both T and AT-points (Fig. 2F). Due to an even number of 
band inversions, PbSnTe2 is also topologically trivial sim- 
ilar to SnTe. But, since PbSnTe2 only has rhombohedral 
instead of cubic symmetry, its band gaps at the T and Ap- 
points become unequal. The band gaps at X points are 
smaller, which indicates that band inversion from PbTe 
to PbSnTe2 occurs first at Y and then at X. This suggests 
that by introducing a small rhombohedral lattice distor- 
tion or by replacing Pb and Sn with other atoms, the 
second band inversion associated with the three Appoints 
might be removed, leaving only a single band inversion 
relative to PbTe (in supercell) at T, which would lead to a 
topologically non-trivial band structure. This leads us to 
replace Pb (Sn) by Tl (Sb) and introduce rhombohedral 
lattice distortion to obtain the bands in Fig. 2D, which 
resemble those of (Pb,Sn)Te. The rhombohedral lattice 
distortion enhances all band gaps, especially at T, and 
shifts the band edges at the A'-points. The bottom of 
the conduction band at the X-point overlaps the top of 
the valence band at a low symmetry point (not shown), 
leading to a semi-metal ground state. Nevertheless, since 
a direct band gap between the conduction and valence 
bands exists throughout the Brillouin zone, the Zi topol- 
ogy of the valence bands is well defined. To determine 
the band topology, one should focus on the band inver- 
sion relative to supercell PbTe at F and three A'-points. 
The s-orbital occupation in Fig. 2D shows that band in- 
version occurs at all four points as in PbSnTe2. Hence, 
in FCC structure, TlSbTe2 and indeed all six Tl-based 
III-V-VI2 ternary chalcogenides presented here, would be 
topologically trivial semi-metals. 

However, experiments la, |2l|, [22j find that the X atom 
moves away from the FCC position towards the M' layer 
in the ordered crystalline phase. We define zx to be the 
distance away from the FCC position for the X atom. 
Fig. 3 gives band structures of TlSbTe2 for the DFT- 
GGA total-energy optimized zt e = 0.21 A value as well 
as for two shifted values of zr e to illustrate the sensitivity 
of band structure to the value of ZTe- The optimized 
value is in good agreement with experiments 22]. For 
ZTe = 0, the band parities at Y and M have the same 
ordering as that in SnTe (Fig. 2E) or PbSnTe 2 (Fig. 2F), 
and the material is topologically trivial. For zt & — 0.21 
A, the band parity at Appoint changes and the Z2 index 
picks up a factor of -1. In addition, the gap between 
the conduction and valence bands becomes large enough 
to make the compound an insulator. Thus, TlSbTe2 is 
predicted to be a topological insulator for the optimized 
Te position. For zr e = 0.33 A, the gap at Y is close 
to zero. As Te atoms move further away, the material 
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FIG. 3: (Color Online) (A)-(C) show the bulk band structure 
of TlSbTe 2 for z Te = 0, 0.21, and 0.33 A, respectively. FCC 
notation for the high-symmetry points is used as in Fig. IB. 
Panels (D) and (E) show the direct gaps at V (blue solid line) 
and X (red dashed line) as a function of V a and ZTe, respec- 
tively. The gray area highlights features related to topological 
non-triviality. Panel (F) shows the surface state dispersions 
at optimized value of zt e in red lines. Projected bulk bands 
are shown as blue areas. 



once again becomes topologically trivial with Z% — 1. 
The range of zx e values which yield a non-trivial phase 
is shown by the gray area in Fig. 3E. This range can be 
ascertained by monitoring the gap sizes at T and X. At 
the critical point where the band inverts, the gap goes 
to zero. We have repeated the preceding procedure for 
other Tl-compounds and find that all these compounds 
become topologically nontrivial at the optimal X-atom 
position except for TlBiS2, which is predicted to be a 
topologically trivial band insulator. 
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In order to test the robustness of our results to ef- 
fects of band gap corrections or alloying, we have consid- 
ered effects of adding an orbital-dependent potential into 
the Hamiltonian. For Tl-based III-V-VI2 ternary chalco- 
genides, the orbital character of the conduction (valence) 
band is p-type for M' (X) atoms. We specifically add 
orbital-dependent potentials V a to all three p-orbitals of 
M', which moves the conduction band upwards. As an 
example, we start with a topologically trivial phase in 
TlSbTc 2 with z Te =0. With increasing V a , as Fig. 3D 
shows, the gap at X vanishes at V a =l cV and band in- 
version occurs. This transition occurs for the T point at 
a larger V a value of 1.6 eV. Between these two critical 
points, bands are inverted only at the T-point relative to 
PbTe and the system becomes topologically non-trivial 
(shaded area in Fig. 3D). We have found a similar be- 
havior in other compounds of this family. Despite un- 
certainties inherent in first-principles computations, our 
calculations establish band inversion at T and Appoints 



FIG. 4: (Color Online) Band structures based on thin slab cal- 
culations for TlSbTe 2 (A), TlSbSe 2 (B), TlSbS 2 (C), TlBiTe 2 
(D), TlBiSe 2 (E), and TlBiS 2 (F) with z x = 0, but without 
bandgap corrections. Blue area marks projected bulk bands. 
Red dots are 2D bands for the thin slab. Parity analysis of 
states at P and M indicates that thin films in panels (A)-(C) 
would harbor topologically nontrivial 2D quantum spin Hall 
states. 



(relative to PbTe) as the decisive factor of their topolog- 
ical class. 

A non-trivial band topology will generate metallic sur- 
face states which are the hallmark of topological insula- 
tors. For the 111 surface in Tl-based III-V-VI2 ternary 
chalcogenides, the atoms are sequenced as -M-X-M'- 
X- and there are four possible surface terminations (see 
Fig. 1A). Unlike Bi2Se3 and Bi2Te3, the bonding between 
the layers in T1M'X2 is not weak. As a result, the topo- 
logically protected surface states may coexist with non- 
topological ones arising from dangling bonds, leading to 
a complicated surface spectrum. We have carried out ex- 
tensive slab calculations on all possible surface termina- 
tions for all six compounds to search for a simple surface 
spectrum. We find that the number of trivial dangling- 
bond surface states is minimized for a termination with X 
atoms exposed and M' atoms beneath the surface, since 
fewer bonds are broken in forming this surface, making 
this the likely candiate for the naturally occuring surface. 
Fig. 3F shows the surface band structure of TlSbTe 2 with 
optimized atomic positions in a topologically non-trivial 
phase. The calculation is based on a slab with 47 atomic 
layers. The Dirac point is at the edge of the conduction 
band at f . Between f and M, there is only one sur- 
face band (red lines) connecting conduction and valence 
bands. This is unambiguous evidence for a non-trivial 
topology. 

Even if the compounds are in a topologically trivial 
phase, their surface states may have Dirac-cone disper- 
sions due to band inversion. In Fig. 4, we show the calcu- 
lated surface dispersions with zt s = without bandgap 
corrections for a 23 layer slab where the X atoms are 
exposed at both sides of the slab. The slab thickness is 
about 50A. Dirac cones with small gaps are obtained at 



r and M due to the projection of T and X points to the 
surface Brillouin zone. The Dirac cones have smaller gaps 
at f in TlSbTe 2 (A), TlSbSe 2 (B), TlSbS 2 (C), TlBiTe 2 
(D), and TlBiSe 2 (E), and at X in TlBiS 2 (F). Con- 
sider TlBiTe 2 as an example. The gap at T decreases 
rapidly as the slab thickness increases, indicating that a 
gapless Dirac band exists at T on the surface in the in- 
finite thickness limit. Note however that the existence 
of a surface Dirac band at T by itself does not reveal 
the band topology, and the surface spectrum near the 
M-points must also be considered. Hence a k ■ p model 
around T is not adequate for these compounds. In our 
slab calculations, surface states near M have strong finite 
size effects arising from interactions between the two end 
surfaces of the slab. This sensitivity to finite size ef- 
fects could be utilized to design thin him samples which 
have quantum spin Hall states. In these films, the Dirac 
points are all gapped, as in Fig. 4, and we can calcu- 
late the 2D topological index Z 2 by analyzing only the 
points r and M. From wavefunction parity analysis at 
these points, illustrated in Fig. 4, we obtain Z 2 = -1 for 
TlSbTe 2 , TlSbSe 2 , TlSbS 2 . Hence these compounds are 
topologically non-trivial quantum spin Hall systems. In 
the case of TlBiTe 2 , the upper and lower Dirac cones are 
almost degenerate at T. 

Interestingly, AgBiTe 2 , AgBiSe 2 , and AgInSe 2 all pos- 
sess a crystal structure similar to the present compounds, 
but with M — Ag. However, our first-principles bulk and 
surface state computations on these Ag-compounds indi- 
cate lack of band inversions. In particular, the surface 
and bulk bands display similar dispersions and there is 
no evidence for the presence of a protected Dirac cone 
surface band or other signatures of topologically inter- 
esting behavior. 

Apart from the fact that Tl-compounds are usually 
semi-metallic or very weakly semiconducting, they are 
topologically similar to the Bi 2 Se3 series discovered pre- 
viously. Recently, it was found that upon Cu doping, 
Bi 2 Se3 becomes a superconductor with a T c = 3.8K 
and exhibits unconventional band topology 28l43Cl| . The 
doped topological states in the Tl-based compounds thus 
are also a likely candidate for finding odd-parity topo- 
logical superconductor similar to the Cu x Bi 2 Se3 series 

In conclusion, we have shown that the Tl-based III-V- 
VI 2 ternary chalcogenides are highly favorable for sup- 
porting Z 2 =-1 topological states. Their topological na- 
ture is driven by the band inversions at both T and X- 
points. We identify the optimal surface termination for 
single Dirac cone surface states and predict that thin 
films could harbor 2D topologically non-trivial quan- 
tum spin Hall states. Our study indicates thus that the 
present Tl-based compounds constitute a fertile ground 
for observing and engineering topologically interesting 
phases of quantum matter. 
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